User interaction based related digital content items

ABSTRACT

Methods and systems to locate related digital content items in a content access log. In one embodiment, the method comprises extracting user events from a content access log, tagging each event as positive or negative, determining if a content item is positively interacted and processing the tagged items in a sliding window to determine positive interactions between a pair of content items.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No.13/216,596, filed on Aug. 24, 2011, entitled “USER INTERACTION BASEDRELATED DIGITAL CONTENT ITEMS,” which is a continuation of U.S. patentapplication Ser. No. 12/032,612 filed Feb. 15, 2008, entitled “USERINTERACTION BASED RELATED DIGITAL CONTENT ITEMS”. The entireties of theaforementioned applications are incorporated herein by reference.

TECHNICAL FIELD

The invention relates to data retrieval, and more particularly, tomethods for identifying digital content items that are related to eachother.

BACKGROUND ART

Video hosting websites allow users to access videos by both searchingusing keywords and by browsing in categories or channels. Using eitherapproach, a user is presented with a list of videos from which he canchoose to view. Once a user finds a video of interest and selects a linkto the video, the link directs the user to a webpage where the video ordetails of the video may be viewed. The video hosting website may allowa user to search and view videos contained within the video hostingwebsite, or videos located or, or sourced from other websites. In somevideo hosting websites, the selection of a video viewing causes thesystem to display a set of videos that are related to the video beingviewed. In conventional methods, the related videos are determined usingkeywords from an initial search, or based upon tags associated with thecurrently viewed video, or based upon which videos or authors arepopular.

While the conventional method can select videos that are potentially ofinterest to the user, many times the selected videos do not contain thematerial the user is interested in and it requires effort on the user'spart to view the content of the individual videos to determine forthemselves if the video contains relevant material. Accordingly, userswaste valuable time viewing videos with potentially no related contentinstead of initially being displayed related videos with a highprobability of containing truly relevant or interesting material.

SUMMARY

Embodiments of the present invention provide methods and systems fordetermining related digital content items which are related to eachbased upon user interactions. Digital content items that userspositively interact with within a locality in time are identified. Thus,if a user views one digital content item and then next views anotherdigital content item, these two digital content items have positiveinteractions within a limited time span; these positive interactions arean example of co-occurring positive interactions. A sufficient number ofpositive interactions between two digital content items (e.g., frommultiple users) are used to identify the two digital content items asbeing related.

For example, a number of users may view a video of a Porsche 997 Turboby one contributor, and then watch a video of Ferrari F430 by anothercontributor within a selected time interval. These positive interactionsare identified based on logs of user interactions stored in a videoaccess log. User interactions include use of any of the controls forvideo playback such as play, pause, forward or rewind, as well asinteractions with the website such as performing a search, changing apage or accessing links in the website. If a sufficient number of suchpositive interactions between these two videos are identified, then thevideos are deemed to be related. This can be the case even if the videohas little or no metadata in common, such as tags, keywords,contributors, or the like.

In one embodiment, a video hosting website maintains a log of userinteractions with videos on the website. The log stores informationabout user events, where user events are user interactions with videos,such as when a user views a video, stops viewing, fast forwards,rewinds, and so forth. The log events are labeled as being positive ornegative by a user interaction analysis server and a determination ismade by the user interaction analysis server if the user positively ornegatively interacted with a video based upon the log event data.Positive interactions of pairs of videos that co-occur within the logare identified in a sliding window and the counts of these interactionsare accumulated to create a co-occurrence matrix. Once the positiveinteractions of pairs of videos have been determined for all users, theco-occurrence matrix is updated to include positive interaction countsacross all users. In alternative embodiments, events produced by certainusers may not be accounted for in the above determination, eitherbecause the users did not authorize their interactions with videos to belogged or because the users are not deemed appropriate participants.Users may not be deemed appropriate participants because the users arenot registered users of the video hosting website, have been banned fromthe video hosting website or for any other appropriate reasons.

The co-occurrence table is analyzed to generate a ranked list of relatedvideos for any target video based on the total amount of positiveinteractions. When a user views a particular video, the ranked list ofrelated videos is concurrently displayed. The user can select one of therelated videos for viewing.

The features and advantages described in this summary and the followingdetailed description are not all-inclusive. Many additional features andadvantages will be apparent to one of ordinary skill in the art in viewof the drawings, specification and claims hereof.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of the system architecture of one embodimentof the present invention.

FIG. 2 illustrates an example of a user interface displaying videosassociated with a user search query.

FIG. 3 illustrates an example of a user interface displaying the targetvideo and its related videos.

FIG. 4 illustrates a method for determining log based related videos inaccordance with one embodiment of the present invention.

The figures depict a preferred embodiment of the present invention forpurposes of illustration only. One skilled in the art will readilyrecognize from the following discussion that alternative embodiments ofthe structures and methods illustrated herein may be employed withoutdeparting from the principles of the invention described herein.

DETAILED DESCRIPTION OF THE INVENTION

System Overview

Referring now to FIG. 1, there is shown the system architecture of avideo hosting website 100 in accordance with one embodiment of thepresent invention. As shown in FIG. 1, a video hosting website 100comprises a front end server 140, a video server 110, an ingest server115, a user interaction analysis server 130, a video search server 145,a related videos database 175, a video access log 160, a user database150, and a video database 190. Many conventional features, such asfirewalls, load balancers, application servers, failover servers, sitemanagement tools and so forth are not shown so as not to obscure thefeatures of the system.

Most generally, the video hosting website 100 represents any system thatallows users to access video content via searching and/or browsinginterfaces. The sources of videos can be from user uploads of videos,searches or crawls of other websites or databases of videos, or thelike, or any combination thereof. For example, in one embodiment a videohosting site 100 can be configured to allow for user uploads of content;in another embodiment a video hosting website 100 can be configured toonly obtain videos from other sources by crawling such sources orsearching such sources in real time. A suitable website 100 forimplementation of the system is the YOUTUBE™ website, found atwww.youtube.com; other video hosting sites are known as well, and can beadapted to operate according to the teaching disclosed herein. It willbe understood that the term “web site” represents any computer systemadapted to serve content using any internetworking protocols, and is notintended to be limited to content uploaded or downloaded via theInternet or the HTTP protocol. In general, functions described in oneembodiment as being performed on the server side can also be performedon the client side in other embodiments if appropriate. In addition, thefunctionality attributed to a particular component can be performed bydifferent or multiple components operating together.

Each of the various servers is implemented as server program executingon server-class computer comprising a CPU, memory, network interface,peripheral interfaces, and other well known components. The computersthemselves preferably run an open-source operating system such as LINUX,have generally high performance CPUs, 1 G or more of memory, and 100 Gor more of disk storage. Of course, other types of computers can beused, and it is expected that as more powerful computers are developedin the future, they can be configured in accordance with the teachingshere. The functionality implemented by any of the elements can beprovided from computer program products that are stored in tangiblecomputer accessible storage mediums (e.g., RAM, hard disk, oroptical/magnetic media).

A client 170 executes a browser 171 and can connect to the front endserver 140 via a network 180, which is typically the internet, but canalso be any network, including but not limited to any combination of aLAN, a MAN, a WAN, a mobile, wired or wireless network, a privatenetwork, or a virtual private network. While only a single client 170and browser 171 are shown, it is understood that very large numbers(e.g., millions) of clients are supported and can be in communicationwith the video hosting website 100 at any time. The client 170 mayinclude a variety of different computing devices. Examples of clientdevices 170 are personal computers, digital assistants, personal digitalassistants, cellular phones, mobile phones, smart phones or laptopcomputers. As will be obvious to one of ordinary skill in the art, thepresent invention is not limited to the devices listed above.

The browser 171 can include a video player (e.g., Flash™ from AdobeSystems, Inc.), or any other player adapted for the video file formatsused in the video hosting website 100. Alternatively, videos can beaccessed by a standalone program separate from the browser 171. A usercan access a video from the video hosting website 100 by browsing acatalog of videos, conducting searches on keywords, reviewing play listsfrom other users or the system administrator (e.g., collections ofvideos forming channels), or viewing videos associated with particularuser groups (e.g., communities).

Users of clients 170 can also search for videos based on keywords, tagsor other metadata. These requests are received as queries by the frontend server 140 and provided to the video search server 145, which isresponsible for searching the video database 190 for videos that satisfythe user queries. The video search server 145 supports searching on anyfielded data for a video, including its title, description, tags,author, category and so forth.

Users of the clients 170 and browser 171 can upload content to the videohosting website 100 via network 180. The uploaded content can include,for example, video, audio or a combination of video and audio. Theuploaded content is processed by an ingest server 115, which processesthe video for storage in the video database 190. This processing caninclude format conversion (transcoding), compression, metadata tagging,and other data processing. An uploaded content file is associated withthe uploading user, and so the user's account record is updated in theuser database 150 as needed.

For purposes of convenience and the description of one embodiment, theuploaded content will be referred to a “videos,” “video files,” or“video items,” but no limitation on the types of content that can beuploaded are intended by this terminology. Thus, the operationsdescribed herein for identifying related items can be applied to anytype of content, not only videos; other suitable type of content itemsinclude audio files (e.g. music, podcasts, audio books, and the like),documents, web sites, images, multimedia presentations, and so forth. Inaddition, related items need not be of the same type. Thus, given avideo, the related items may include one or more audio files, documents,and so forth in addition to other videos.

The video database 190 is used to store the ingested videos. The videodatabase 190 stores video content and associated metadata, provided bytheir respective content owners. Each uploaded video is assigned a videoidentifier (id) when it is processed by the ingest server 115. The videofiles have metadata associated with each file such as a video ID,artist, video title, label, genre, time length, and optionallygeo-restrictions that can be used for data collection or contentblocking on a geographic basis.

The user database 150 is responsible for maintaining a record of allusers viewing videos on the website. Each individual user is assigned auser ID, for example, based on his or her IP address to differentiatethe individual users. This user ID is preferably an anonymized user IDthat is assigned to each individual user to keep user identitiesprivate. For each user, the video access log 160 tracks the user'sinteractions with videos. Each entry in the video access log 160identifies a video being accessed, a time of access, an IP address ofthe user, a user ID if available, cookies, the user's search query thatled to the current access, data identifying the type of interaction withthe video. Interaction types can include any user interactions in theuser interface of the website 175, such as playing, pausing, rewindingand forwarding a video. The various user interaction types areconsidered user events that are associated with a given video. Inalternative embodiments, user IDs many not be maintained and the videoaccess log 160 stores all user events regardless of whether a user ID isknown.

The user interaction analysis server 130 processes the events in thevideo access log 160 to determine related videos. The user interactionanalysis server 130 operates to identify related videos for a givenuser, as well as related videos across all users. The cumulative data isaggregated and ranked to create a list of related videos for a targetvideo. The related videos database 175 stores all the lists of relatedvideos in the related videos database 170. The lists of related videosare updated each day, in one example, with the user interaction analysisserver 130 performing a daily analysis of user events from the videoaccess log 160 and user database 150. Once the list of related videoshas been generated, the video server 110 can serve the related videosfrom the video database 190.

Video Serving

A user of client 170 executes the browser 171 to load a website 175,such as YOUTUBE™, to watch a video. The user can either search forvideos using keywords, or may browse via various categories or channels.The video search server 145 locates appropriate videos in the videodatabase 190 to return to client 170. Referring to FIG. 2, a userinterface is displayed which illustrates a result page, from the website175, responsive to the user querying the keyword “Ducati” into thedialog box 201. Accordingly, a list is displayed of appropriate videosfor the keyword such as “La storia della Ducati Superbike” 203 and“Lamborghini Gallardo vs. Ducati 999” 205 that were retrieved from thevideo database 190. After reviewing the result page, the user can selecta video from the result page to watch.

After selection of the target video, the browser 171 displays a videoviewing page with the selected video for presentation. FIG. 3 isillustrative, in one example, of a video viewing page. The browser 171displays the selected target video 301, for the user to watch. Thedisplayed page also depicts to the user, related videos 303 which aredetermined by the user interaction analysis server 130 using the userinteraction analysis process. The videos that are identified to berelated to a target video are retrieved from the video database 190 bythe video server 110 for user presentation. The user interactionanalysis process that determines the related videos for a target videois further described below.

User Interaction Analysis

The user interaction analysis process of the user interaction analysisserver 130 determines related videos for a given video. Related videosare pairs of videos that users positively interact within a locality oftime. The user interaction analysis server 130 determines that there isa sufficient count of positive interactions between pairs of videosacross all users who have viewed the pairs of videos within a determinedtime interval. Positive interactions between pairs of videos can occurwithin a one hour time interval in one example. The user interactionanalysis process that determines a related videos list is furtherdescribed below.

Referring now to FIG. 4, the user interaction analysis process accordingto one embodiment has the following functional stages:

402: Extract user events from a log database.

404: Tag each event as positive or negative.

406: Tag each video associated with the tagged events as positivelyinteracted or negatively interacted and sequence all the tagged videosin time.

408: Process the tagged videos in a sliding window to determine positiveinteractions between pairs of videos.

Each of these stages will now be described in further detail.

The first stage 402 is a process repeated for each user having a user IDin the user database. For a given user, the user interaction analysisserver 130 extracts events from the video access log 160. As a userinteracts with the user interface shown in FIG. 3, the video access log160 stores each interaction as an event. For every video, a record iskept of user interactions with the video via the website interface whilewatching the video. The website interface for viewing videos can be, forexample, the interface shown in FIG. 3. User interactions include use ofany of the controls for video playback (e.g., play, pause, forward,rewind), as well interactions with the site (search, change page, linkaccesses) that occur during the viewing of the video. Each interactionis associated with a time offset (or timestamp, or time code) that canbe used, in one example, to tag events as either positive or negativeinteractions. For example, when a playback interaction is stored, a timeoffset indicating the continuous time duration in which the video wasplayed is associated with the playback event. In the case of a playbackinteraction, the time offset is used to determine if the event ispositive or negative based upon the play time (amount of time the userplays back the vide), and/or a ratio of the play time and length of thevideo. For example, a user viewing a video for at least 30 seconds or atleast 25% of a video's entire length, would indicate that the event canbe identified as a positive interaction. Tagging events based upon timeoffsets is further described below.

Each user interaction is stored as an event in the video access log 160.The video access log 160 stores all user interactions for all videosstored in the video database 190. Each event entry in the video accesslog 160 includes the tag ID of the user viewing the video and a video IDto associate the event with a particular video. The tag IDdifferentiates the user events for each individual user and will be usedin the user interaction analysis further described below.

In the first stage 402 of the user interaction analysis process, theuser interaction analysis server 130 extracts the user events for agiven user stored in video access log 160 for analysis to begin the userinteraction analysis process to update the related videos database 170.The extracted list of stored events from the video access log 160 isthen used in the second stage of the user interaction analysis.

The second stage 404 is a process by which for each user, the userinteraction analysis server 130 tags the events associated with a videostored in the video access log 160 as either a positive or negativeinteraction. In one example, an event can be tagged “1” representing apositive interaction and can be tagged “0” representing a negativeinteraction (any equivalent coding system may be used as well). Taggingevents “1” or “0” is merely illustrative of one method to tag events andany real-valued or discrete function can be used. An event is determinedto be positive or negative based on various factors. For example, for aplayback event, the user interaction analysis server 130 determines thetime offset of the playback event. If the time offset in which the videowas continuously played is equal to the length of the entire video, theplayback event is tagged “1” indicating a positive event since the userviewed the entire video. Alternatively, if the ratio of the videowatched versus the length of the entire video is greater than 75% thanthe playback event would be tagged “1” indicating a positive event. Inother embodiments, if the user has viewed the video for a predefinedlength of time regardless of the video length, the event is tagged “1.”For example, a user may have viewed a video for a total duration of 3minutes, but the video length is only 1 minute long. This implies thatthe user viewed the video multiple times so the event would be tagged“1.” A rating event also indicates a positive event if the user ratedthe video 5 out of 5 stars in one example. Alternatively, if the ratingevent is greater than a predetermined threshold, such as a rating above3 out of 5 stars, the rating would indicate a positive event. A rewindevent to the beginning of the video or back to a set percentage of thevideo is another indication of a positive event. Rewinding the videoindicates that the video will be viewed again thus signifying a positiveevent. Additional positive events comprise scrolling the page or a frameof the page containing the video or fast forwarding or dragging thescroll button to move the position at which the video is playing may beindications of positive events. A negative event can comprise the useronly viewing less than 25% of the entire video before playback isstopped, viewing the video less than a set amount of time (e.g., lessthan 5 seconds) or if the user provided a low rating of the video suchas 1 out of 5 stars. Additionally, performing another search can be seenas a negative event as the user is not satisfied with the current video.Opening other web pages can indicate a negative event as the currentvideo is not captivating the user's attention. Analysis of text commentsand/or comments in webcam form (including either video or audiocomments) can also be used to determine whether an event is to be taggeda positive or negative event depending on the comments. Any discernableinteraction with the website may illuminate the user's satisfaction withthe video can be used to tag events as either positive or negative, solong as the semantics of the interaction can be meaningfully correlatedwith a user intent. Upon completion of this stage, the user interactionanalysis server 130 has a list of tagged events for a given user. Thislist of events may be time delimited (events in the last month or week,for example), or for all events by the user.

The third stage 406 of the user interaction analysis process determinesif a video was positively interacted with by a user. The userinteraction analysis server 130 determines based upon the list of taggedevents associated with a video ID, if the user had a positiveinteraction with the video by evaluating the tagged events. Certainevents automatically indicate a video was positively interacted. Forexample, if a playback event, as described above, indicates the usercontinuously viewed the entire video, then the video was positivelyinteracted. The user watching the entire video implies satisfaction inthe video because the user took the time to view the video in itsentirety. Alternatively, if the event comprises rating the video 5 outof 5 stars than the rating event implies user satisfaction with thevideo. These events automatically designate that the particular videobeing analyzed by the user interaction analysis server was positivelyinteracted by the user. The video is then tagged with a “1” indicatingthe positive interaction. Additionally, videos can be positivelyinteracted when the user rewinds the video and replays a part of thevideo or if a user leaves a positive comment about the video.

Videos can also be automatically tagged as negatively interacted with,based on certain events indicating a negative interaction. For example,if a watch ratio (e.g. the ratio of the play time to the length of thevideo) is less than a predetermined value, such as 25%, the event wouldautomatically indicate that the user did not have a positive interactionand the video would be tagged with as negatively interacted with.Alternatively, if the video access log 160 comprises an event associatedwith the user rating the video a low score, such as 1 out of 5 stars,for example, the low rating event would automatically indicate that theuser did not have a positive interaction with the video and the videowould be tagged as being negatively interacted. Additionally, a videocan be automatically tagged as being negatively interacted with if auser leaves a negative comment about the video or performs a new search.

Once all the videos in the video access log 160 associated with aparticular user ID have been tagged as either being positivelyinteracted or negatively interacted, the tagged list of videos aresequenced in time (e.g., by the time of the first user interaction) bythe user interaction analysis server 130 to create a sequenced list oftagged videos. The tagged list of sequenced videos identifies videosthat a user viewed chronologically in time indicating the videos theuser had a positive interaction with and videos which were negativelyinteracted. By analyzing the tags associated with pairs of videos in asliding window, the user interaction analysis server 130 determinespairs of videos which were positively interacted. Generally, when twovideos within a selected time interval are both positively interactedwith, then the videos are deemed to be related.

An example of the sequenced list of tagged videos is as follows:

Video Tag V₁ 1 V₂ 1 V₃ 0 V₄ 1

The column “Video” represents the various videos a user has viewed inthe order of viewing based on time stamps stored in the video access log160, where V₁, V₂, etc represent the individual videos watched by theuser. The “Tag” column is representative of the associated video beingtagged as either having a positive interaction (1) or having a negativeinteraction (0).

The fourth stage 408 of the user interaction analysis process processesthe tagged videos in a sliding window as shown in the example below:

Video Tag V₁ V₂ V₃

V₄ 1

The user interaction analysis server 130 utilizes a sliding window asone way of establishing a time interval, depicted by the rectangleenclosing the first three tags, to analyze the interaction tags todetermine if a pair of videos was positively interacted by a user. Thesliding window is iteratively advanced through the sequence ofinteraction tags for the user, and each pair wise combination of thefirst video in the window with each other video in the window isanalyzed. All interaction tags within the sliding window are said toco-occur. Generally, the user interaction analysis server 130 identifiespairs of videos (V_(i), V_(j)) where both videos are positivelyinteracted with, that is where tags T_(i)=T_(j)=1. Each time a pair ofvideos (V_(i), V_(j)) are positively interacted with, a co-occurrencematrix, as further described below, stores the positive counts ofinteractions between the pair of videos. Any other combination ofinteractions, such as tag pairs (1,0), (0,1) and (0,0), do not indicatea positive relationship between the two videos under consideration andare not reflected in the co-occurrence matrix.

In the above example, the sliding window allows for analysis of relatedvideos for the target video, which in this example is V₁. Theinteraction tags of the first and second videos (V₁ and V₂ respectively)in the list are the first pair of tags to undergo analysis. In the caseof V₁ and V₂, V₁ is tagged “1” which indicates the video was positivelyinteracted and V₂ is also tagged “1” indicating the video was alsopositively interacted. The pair of videos were both tagged “1” whichindicates a positive interaction between the pair of videos. Thus, V₁and V₂ had co-occurring positive interactions. In the case of V₁ and V₃,V₁ is tagged “1” which indicates the video was positively interacted,but V₃ is tagged “0” which indicates a negative interaction with thevideo. Thus, this pair does not indicate a positive relationship betweenV₁ and V₃.

The sliding window below is an example of the sliding window analyzingthe next target video, in this case the target video is V₂, with thepossible video pair combinations with V₃ and V₄.

Video Tag V₁ 1 V₂ V₃ V₄

Here, video pair V₂ and V₃ have a tag sequence of (1, 0) respectively,which does not indicate a positive relationship. The next paircombination with the target video for analysis is V₂ and V₄ which has atag sequence of (1, 1) respectively, thus indicating a positiveinteraction was made with both videos which were sequentially viewed intime. Thus, V₂ and V₄ had co-occurring positive interactions.

The above example of the sliding window with three videos is a verysimplified one for purposes of explanation only. Any number of methodsto determine positive co-occurrences between videos can be used. Moregenerally, the sliding window represents a time interval for identifyingco-occurring positive interactions for pairs of videos. The slidingwindow can be implemented with either a fixed time length, or a variabletime length. In one embodiment, the sliding window size is one (1) hourso that only pairs of videos viewed within one hour of each other areanalyzed for positive interactions. Generally, when users are watchingvideos, multiple videos are viewed and the video content from the firstvideo watched in the time session compared to the last video watched candiffer greatly. Using a time window of one hour increases the likelihoodthat the videos in the sliding window are still related to one another.

Alternatively, the time length of the sliding window can be dynamic andvary based a number of factors. One factor for varying the slidingwindow length is user activity for the user whose videos are beingprocessed. Some users view more videos than others either overall, or atfaster rate (i.e., more videos per unit time). For users who view morevideos per unit time, the sliding window can be adjusted to have ashorter time span, such as 30 minutes. The length of the window can beset for a user to reach a desired number of video views per unit timefor the sliding window, based on the user's average rate of views. Forexample, if the user views an average of 20 videos per hour, and thetarget for the sliding window is 10 videos, then the sliding windowlength is set to 30 minutes for this user. Thus, a shorter time windowis utilized to capture the shifts in interest for users who have a highview rate, so that the user interaction analysis server 130 canaccurately determine related videos based on the viewing behaviors ofeach user. Another factor for dynamically varying the window length iswhether the user performs a search during a viewing session. Here, eachsearch is used to restart the sliding window, as the search is used toindicate a shift in user interest. Restarting the sliding window inresponse to a new search query prevents pairs of videos which werepositively interacted, but are separated from a new search query eventindicating a shift in user interest, from being considered relatedvideos. Alternatively, the sliding window may be restarted in responseto other user behaviors, such as a selection of a specific category orchannel of videos for browsing.

Users who are not actively viewing videos may have a longer slidingwindow time where pairs of videos are analyzed by the user interactionanalysis server 130. This is appropriate as some users may only view afew videos every few hours and as long as a new search is not performed,the sliding window is used to analyze the watched videos within a timeframe of a few hours to a day, for example.

During the fourth stage 408 of the user interaction analysis process,the user interaction analysis server 130 may analyze the time stamps ofthe videos in the sliding window to determine if a software robot may beaccessing the videos, to create inaccurate viewing data. The analysisserver 130 uses a filter based on the rate of video accesses (e.g.,views) by a user. For example, if a “user” has watched over 100 videoswithin a time span of 2 minutes, this would indicate to the userinteraction analysis server 130 that a software robot has been accessingthe videos, as no human is capable of viewing such a large quantity ofvideos in a short time span. This false activity detection filters outthe interaction data that is created by a robot watching videos as thedata can create false positives of videos that are said to havepositively interacted, when in reality the pairs of videos were notrelated.

Once the user interaction analysis process completes for an individualuser, the user interaction analysis process as previously discussedabove in reference to FIG. 4, will be performed for all (or someselection of) users listed in the user database 150. After the userinteraction analysis process is complete for the selected users, theco-occurrence matrix holds the updated the positive interaction countsbetween pairs of videos.

A co-occurrence matrix is used to store counts of positive interactionco-occurrences for each pair of videos in the database. Each time a pairof videos (V_(i), V_(j)) have a positive relationship (e.g., a pair ofpositive interactions), the interaction count for the pair is updated.The interaction counts are preferably incremented onlyuni-directionally, that is the count for (V_(i), V_(j)) is incremented,but not for (V_(j), V_(i)) where the positive interaction with V_(i)precedes the positive interaction for V_(j). Alternatively, the countscan be incremented bidirectionally, with the counts for both (V_(i),V_(j)) and (V_(j), V_(i)) updated. The co-occurrence counts will be usedto rank the list of related videos, which is further described below. Asimplified example of the co-occurrence table that is created by theuser interaction analysis server 130 is as follows:

Related Videos V_(a) V_(b) V_(c) V_(d) Any Video V_(a) — 15 2 30 V_(b) 1— 50 9 V_(c) 2 1 — 20 V_(d) 20 30 25 —

The table above depicts a very simplified co-occurrence table of thetype that would be stored in the videos database 170. The videos V_(a)through V_(d) are illustrative of the total videos stored in the videodatabase 190 and one skilled in the art will understand any number ofvideos can be stored in the video database 190. For any given video,such as V_(a), a count (or real value) is maintained of every instance apositive interaction occurred between V_(a) and related video V_(b)through V_(d) during the fourth stage 408 of the user interactionanalysis process. The count is maintained across all users in the userdatabase 150, thus the related video table represents all positiveinteractions between pairs of videos. In the example above, video V_(a)was positively interacted with video V_(b) 15 times while V_(a) waspositively interacted with video V_(c) only 2 times. The positiveinteraction counts are analyzed by the user interaction analysis server130 to generate a ranked list of related videos for any given videowhich is further described below.

In an alternative embodiment, real number weights are used to update theco-occurrence counts, by weighting the interaction tags for videosaccording to a distance measure between the two videos. One method ofweighting the interactions is to use position distance within thesliding window, as follows. Within the sliding window, there is thetarget video (the first video) and each of the remaining videos, thesecond through Nth video. Each video (or position in the list) is givena weight, starting with a highest weight (1) for the second video, andscaled through the Nth video over a range from the maximum weight of 1to a minimum weight. The weighting can be a step function, a linearfunction, a logarithmic function, or some other function. For example,in a sliding window of 5 videos, a step function would weight the videoswith values of 0.9, 0.8, 0.7, and 0.6, for the second through fifthvideos respectively. When updating the co-occurrence count for a pair ofvideos (V_(i), V_(j)), the count is updated by the weight for videoV_(j). This reflects that the greater the temporal separation betweenthe two videos, the less significant is the positive relationshipbetween them deemed to be.

Alternatively, the weights can be decayed using a distance measure basedon time. The weight of the interaction can be inversely related to thelength of time between the time the target video was viewed and the timethe second video was viewed. Alternatively, the weight can be inverselyproportional to the length of time between when the second video wasviewed and the current time when the analysis is being performed.

The user interaction analysis server 130 analyzes the co-occurrencetable to generate a ranked list of related videos for any given video.Additionally, if a related video is not positively interacted apredetermined amount of total instances (i.e. spam), the given video canbe removed from the related videos database 175 until the next userinteraction analysis process occurs. Once all spam has been removed fromthe table, a ranked list of related videos is created for every video inthe video database 190. The ranking can be based on any number ofcriteria. In one embodiment, the ranking occurs based on the totalamount of positive interactions. For example, for a given row,representing a video (e.g., V_(a)), the videos listed therein can besorted by their interaction counts, from highest to lowest. This forms alist of videos that are related to the given video. Thus, for a givenvideo, the related video with the highest count of positive interactionswould be the first video displayed in related videos section 303 of thevideo viewing page shown in FIG. 3. For example using the previous tableabove, if a user selected a target video for viewing such as a videoV_(a), the related videos would be listed in the order V_(d), V_(b), andV_(c). Videos with a positive interaction count below a minimumthreshold (e.g., 10) may be removed, for example V_(c), which has acount of 2.

Alternatively, the related videos can be ranked based on the totalaccumulated time watched for each related video. Because each count ofpositive interaction is associated with a particular user in the userdatabase 150, the user interaction analysis server 130 can determine thetotal amount of time a related video was viewed by all users, byretrieving the playback event data from the video access log 160. Thismethod of ranking the related videos is beneficial because though aparticular video had the most counts of positive interactions it may notnecessarily be the most related video. The video may have just met theminimum criteria to be determined positively interacted in the thirdstage 406 of the user interaction analysis process amongst all theusers, whereas another related video may have had a lower amount ofpositive interactions, but each user who had a positive interaction withthe related video watched the video entirely. This method takes intoaccount the playback event, which is one of the most significant eventsthat indicate a positive interaction with a video. For example, eventhough video V_(d) has a higher positive interaction count then V_(b)above, the total playback time for V_(b) may be higher then for V_(d).Alternatively, the related videos can be ranked by their rating data,number of comments, recency of posting, other metadata, or aggregateddata, or upon a weighted combination of these various metrics (includingpositive co-occurrence count).

The ranked list of related videos for all videos in the video database190 is stored in the related videos database 170. The ranked list ofrelated videos is used by the video search server 145 to return a listof related videos 303 after a target video has been selected for viewingby the user. The return list of related videos 303 can be rankedaccording to a separate criteria or attribute from that used to selectthe list. For example, the ranking for selection as related videos canbe based on the counts of the positive co-occurring interactions, whilethe ranking for display can be based on total playback time of each ofthe selected videos.

The ranked list of related videos in one embodiment is updated on adaily basis through the user interaction analysis process describedabove. This beneficially ensures the most up to date relevant videos ispresented to users. Alternatively, the ranked list is updated once aweek or once a month. The time in which the ranked list is updated ismerely illustrative of the times in which an appropriate update can takeplace and the update can occur at any suitable time set by theadministrator of the video hosting website 100.

The present invention has been described in particular detail withrespect to one possible embodiment pertaining to videos. Those of skillin the art will appreciate that the invention may be practiced in otherembodiments relating to various types of digital content items. Theoperations described herein for identifying related items can be appliedto any type of digital content item such as audio files (e.g. music,podcasts, audio books), documents, web pages, images, games, multimediapresentations, and so forth. Additionally, the related items need not beof the same type. For example, given a video, the related items mayinclude one or more audio files, documents, and so forth in addition toother videos.

Users of the clients 170 and browsers 171 can upload digital contentitems to a hosting website 100. The video database 190 would be ageneral content database that can be used to store all the uploadeddigital content items regardless of type. Alternatively, additionaldatabases can be included in the content hosting website 100. Eachadditional database can be used to store one particular type of digitalcontent item. User accesses to content would be recorded in a contentaccess log, similar to the video access log 160.

Referring to FIG. 2, a user interface is displayed which illustrates aresult page responsive to a user query. Rather than displaying only alist of appropriate videos responsive to the user query, in analternative embodiment, a list of appropriate digital content items ispresented to the user. For example, the user may query “ducati” and thesubsequent results would include videos, documents, images, audio files,etc that are appropriate digital content items for the keyword in thequery. Alternatively, only digital content items of a specific type aredisplayed.

After a selection of a digital content item from the results, thebrowser 171 displays a viewing page with the selected digital contentitem for presentation. FIG. 3 is illustrative, in one example, of adigital content item viewing page. Rather than displaying only a video,the viewing page illustrated in FIG. 3 is configured to display any typeof digital content item. The displayed page also depicts to the user,related digital content items 303 which are determined by the userinteraction analysis server 130 using the user interaction analysisprocess. In one embodiment, only related digital content items of thesame type are displayed. Alternatively, any digital content item,regardless of type are displayed in conjunction with the digital contentitem selected for viewing. The digital content items that are identifiedto be related to a target digital content item are determined by theuser interaction analysis server 130 using the user interaction analysisprocess below.

The user interaction analysis process of the user interaction analysisserver 130, as discussed above in regards to related videos, candetermine related digital content items for a given digital contentitem. For example, the user interaction analysis server 130 determinesthe related digital content items for an image, where the relateddigital content items in one embodiment are limited to only otherimages. Alternatively, the related digital content items can includeother digital content items such as audio files, documents or videos.The user interaction analysis server 130 determines that there is asufficient count of positive interactions between pairs of digitalcontent items across all users who have viewed the pairs of digitalcontent items within a determined time interval as previously discussedabove.

As previously discussed in reference to FIG. 4, the user interactionanalysis process according to one embodiment has the following functionstages:

402: Extract user events from a log database.

404: Tag each event as positive or negative.

406: Tag each video associated with the tagged events as positivelyinteracted or negatively interacted and sequence all the tagged videosin time.

408: Process the tagged videos in a sliding window to determine positiveinteractions between pairs of videos.

The concepts represented in each of the stages, as previously discussedabove, can be similarly applied when determining related digital contentitems other than for videos.

The first stage 402 is a process repeated for each user having a user IDin the user database. For a given user, the user interaction analysisserver 130 extracts events from the content access log which is used tostore all user interactions with the digital content items. As a userinteracts with the user interface shown in FIG. 3, the content accesslog stores each interaction as an event. For example, user interactionswith an image or document can be users simply leaving the browsercontaining the user interface in FIG. 3 open. Leaving the browser openindicates that a user may be looking at or reading the image/document.The act of leaving the browser open represents a viewing event. Also, auser interaction with an image or document can entail the user copyingand pasting the image or copying and pasting text within the document.These user interactions are representative of a reproduction event. Theuser saving the image/document can also constitute as a reproductionevent. The user printing the image/document can also constitute areproduction event.

The user interactions previously described above in regards to use ofany of the controls of playback for videos can be applied to audio filesor multimedia presentations. User interactions with a web page mayinclude clicking on links that direct the user to another page on thewebsite. The mere act or lack of clicking links on a web page isclassified as browsing events. Also, reproduction events associated witha web page include the user copying and pasting or saving any images ortext within the web page. The amount of time spent on the web page isalso considered a viewing event by the user interaction analysis server130. Users can also bookmark the web page for later use indicating abookmarking event.

In one embodiment, all user interactions are stored in a common accesslog such as the content access log. Storing all user interactions in acommon access log allows the user interaction analysis server 130 todetermine all related digital content items for a given digital contentitem regardless of type.

The user interaction analysis server 130 extracts the user events for agiven digital content item stored in the content access log for analysisto determine all types of digital content items which are related to atarget digital content item. The extracted list of stored events fromthe content access log is then used in the second stage of the userinteraction analysis process.

The second stage 404 is a process by which for each user, the userinteraction analysis server 130 tags the events associated with adigital content item stored in the access log as either a positive ornegative interaction. As previously discussed, events can be tagged “1”representing a positive interaction and can be tagged “0” indicating anegative interaction. Tagging events “1” or “0” is merely illustrativeof one method to tag events and any real-valued or discrete function canbe used. An event is determined to be positive or negative based onvarious factors. For example, a viewing event associated with an imageor document may be deemed a positive event by the user interactionanalysis server 130 based on the amount of time the browser was leftopen. If a user viewed an image or document for greater than, forexample, 10 seconds, the viewing event can be deemed positive. Note thatany appropriate time length can be used to determine a positive event.Additionally, if a reproduction event comprises the user copying andpasting an image or document, the event can be deemed positive andtagged “1.”Also, if a user saves the image or the document to a computerreadable storage device, this reproduction event indicates a positiveevent and the event is tagged “1.”

An event associated with an image or video can be determined a negativeevent based on various factors. For example, if the user closed thebrowser containing the image or document within a predefined amount oftime, the viewing event may be deemed negative and the event would betagged “0.” Additionally a low rating event, such as a user giving arating of 1 out of 5 stars would indicate a negative event.

The positive and negative events previously discussed above in regardsto videos can be equally applied to digital content items such as audioand multimedia which require use of controls for playback.

For user interactions with a web page, a browsing event may be taggedpositive if the user navigated through the website by clicking onvarious links within the web page. The act of navigating the websiteindicates the website is potentially useful to the user as the user isviewing the other web pages within the website. Additionally, if theuser copies and pastes or saves or prints any images or text from thewebsite, these reproduction events are indicative of a positive event.The reproduction event indicates that the website contains usefulmaterial since the user took the time and effort to reproduce the imagesor text. A viewing event also can indicate that the user had a positiveinteraction with the web site if the user viewed the website for apredefined amount of time. If a user bookmarks a web page, thebookmarking event indicates a positive event. Negative events for a webpage can be determined from the viewing event. For example, if the userclosed the web page within a predefined amount of time, the viewingevent would be considered a negative event and tagged “0.” Additionally,any rating events below a predetermined threshold may indicate anegative event.

The third stage 406 of the user interaction analysis process determinesif a digital content item was positively interacted with by a user. Aspreviously discussed, the concept that certain events automaticallywarrant a video as being tagged as positively or negatively interactedwith can equally apply to the various digital content items discussedherein. For example, a reproduction event associated with an image ordocument automatically indicates that the image/document was positivelyinteracted with since the user found the content of the image/documentuseful enough to warrant copying or saving the image/document. Thus, theimage/document would be tagged a “1” indicating that the image/documentwas positively interacted. Additionally, if a rating event associatedwith the image/document comprises a rating of 5 out of 5 starts forexample, the image/document is determined to be positively interactedwith. A viewing event associated with the image/document greater than apredetermined amount of time would also automatically indicate that theuser had a positive interaction with the image/document. Animage/document may be negatively interacted with and tagged a “0” if arating event associated with the image/document was a low rating such as1 out of 5 starts for example. This low rating event automaticallyindicates that the user did not have a positive interaction with theimage/document.

Web pages may be automatically tagged a “1” indicating that the web pagewas positively interacted with if any reproduction event is associatedwith the web page. The fact that the user took time to reproduce animage or text from the web page indicates that the web page containsuseful information. A rating event of 5 out of 5 stars, for example,also would also automatically indicate that the web page was positivelyinteracted with. Additionally, if a bookmarking event is present, thebookmarking event would automatically indicate that the web page waspositively interacted with. Events such as a short viewing event (e.g.,less than 5 seconds) can automatically indicate that the user had anegative interaction with the web page. Additionally any low ratingevent or negative comments associated with the web page automaticallyindicate that the web page was negatively interacted.

Once all the digital content items in the video access log 160associated with a particular user ID have been tagged as either beingpositively or negatively interacted with, the tagged list of digitalcontent items are sequenced in time, as previously discussed. Theremaining processes described above in regards to determining relatedvideos for a given video are performed. The remaining processes resultsin a ranked list of related digital content items for all digitalcontent items available within the video hosting website 100.

The present invention has been described in particular detail withrespect to one possible embodiment. First, the particular naming of thecomponents, capitalization of terms, the attributes, data structures, orany other programming or structural aspect is not mandatory orsignificant, and the mechanisms that implement the invention or itsfeatures may have different names, formats, or protocols. Further, thesystem may be implemented via a combination of hardware and software, asdescribed, or entirely in hardware elements. Also, the particulardivision of functionality between the various system componentsdescribed herein is merely exemplary, and not mandatory; functionsperformed by a single system component may instead be performed bymultiple components, and functions performed by multiple components mayinstead performed by a single component.

Finally, it should be noted that the language used in the specificationhas been principally selected for readability and instructionalpurposes, and may not have been selected to delineate or circumscribethe inventive subject matter. Accordingly, the disclosure of the presentinvention is intended to be illustrative, but not limiting, of the scopeof the invention, which is set forth in the following claims.

What is claimed is:
 1. A system comprising: a processor; a memorycommunicatively coupled to the processor, the memory having storedtherein computer-executable instructions, comprising: a user databaseconfigured to store user interactions events associated with a pluralityof digital content items, wherein the respective user interaction eventshave associated respective user identifications and respectivetimestamps; and a user interaction analysis component configured toidentify pairs of digital content items from the plurality of digitalcontent items having the associated respective user interaction eventswith common user identifications and that are positive and having theassociated respective timestamps within respective sliding time windowsdefined for the respective user identifications, the respective slidingtime windows having respective dynamically adjusted lengths or startingpoints based upon respective factors associated with the respective useridentifications.
 2. The system of claim 1, wherein a factor is a numberof digital content items viewed per unit of time associated with a useridentification.
 3. The system of claim 2, wherein the user interactionanalysis component is further configured to select a length to achievethe desired number of digital content items viewed per unit of time in asliding window.
 4. The system of claim 1, wherein a factor is a userinteraction event that is a search, and the user interaction analysiscomponent is further configured to restart a starting point of a slidingwindow at a timestamp associated with the user interaction event.
 5. Thesystem of claim 1, wherein a factor is a user interaction event that isa selection of a category of digital content items for browsing, and theuser interaction analysis component is further configured to restart astarting point of a sliding window at a timestamp associated with theuser interaction event.
 6. The system of claim 1, wherein the userinteraction analysis component is further configured to determinewhether user interaction events associated with a user identificationare generated by a software robot based upon a rate of viewing of thedigital content items associated with the user interaction events. 7.The system of claim 1, wherein the user interaction analysis componentis further configured to generate a co-occurrence matrix that countsrespective occurrences of respective identifications of pairs of digitalcontent items from the plurality of digital content items having theassociated respective user interaction events with the common useridentifications and that are positive and having the associatedrespective timestamps within the respective sliding time windows.
 8. Amethod comprising: storing, by a device including a processor, userinteractions events associated with a plurality of digital contentitems, wherein the respective user interaction events have associatedrespective user identifications and respective timestamps; andidentifying, by the device, pairs of digital content items from theplurality of digital content items having the associated respective userinteraction events with common user identifications and that arepositive and having the associated respective timestamps withinrespective sliding time windows defined for the respective useridentifications, the respective sliding time windows having respectivedynamically adjusted lengths or starting points based upon respectivefactors associated with the respective user identifications.
 9. Themethod of claim 8, wherein a factor is a number of digital content itemsviewed per unit of time associated with a user identification.
 10. Themethod of claim 9, further comprising selecting, by the device, a lengthto achieve the desired number of digital content items viewed per unitof time in a sliding window.
 11. The method of claim 8, furthercomprising wherein a factor is a user interaction event that is asearch, and restarting, by the device, a starting point of a slidingwindow at a timestamp associated with the user interaction event. 12.The method of claim 8, further comprising wherein a factor is a userinteraction event that is a selection of a category of digital contentitems for browsing, and restarting, by the device a starting point of asliding window at a timestamp associated with the user interactionevent.
 13. The method of claim 8, further comprising determining, by thedevice, whether user interaction events associated with a useridentification are generated by a software robot based upon a rate ofviewing of the digital content items associated with the userinteraction events.
 14. The method of claim 8, further comprisinggenerating, by the device, a co-occurrence matrix that counts respectiveoccurrences of respective identifications of pairs of digital contentitems from the plurality of digital content items having the associatedrespective user interaction events with the common user identificationsand that are positive and having the associated respective timestampswithin the respective sliding time windows.
 15. A non-transitorycomputer-readable medium having instructions stored thereon that, inresponse to execution, cause at least one device including a processorto perform operations comprising: storing user interactions eventsassociated with a plurality of digital content items, wherein therespective user interaction events have associated respective useridentifications and respective timestamps; and identifying pairs ofdigital content items from the plurality of digital content items havingthe associated respective user interaction events with common useridentifications and that are positive and having the associatedrespective timestamps within respective sliding time windows defined forthe respective user identifications, the respective sliding time windowshaving respective dynamically adjusted lengths or starting points basedupon respective factors associated with the respective useridentifications.
 16. The non-transitory computer-readable medium ofclaim 15, wherein a factor is a number of digital content items viewedper unit of time associated with a user identification.
 17. Thenon-transitory computer-readable medium of claim 16, the operationsfurther comprising selecting a length to achieve the desired number ofdigital content items viewed per unit of time in a sliding window. 18.The non-transitory computer-readable medium of claim 15, the operationsfurther comprising wherein a factor is a user interaction event that isa search, and restarting a starting point of a sliding window at atimestamp associated with the user interaction event.
 19. Thenon-transitory computer-readable medium of claim 15, the operationsfurther comprising wherein a factor is a user interaction event that isa selection of a category of digital content items for browsing, andrestarting a starting point of a sliding window at a timestampassociated with the user interaction event.
 20. The non-transitorycomputer-readable medium of claim 15, the operations further comprisingdetermining whether user interaction events associated with a useridentification are generated by a software robot based upon a rate ofviewing of the digital content items associated with the userinteraction events.
 21. The non-transitory computer-readable medium ofclaim 15, the operations further comprising generating a co-occurrencematrix that counts respective occurrences of respective identificationsof pairs of digital content items from the plurality of digital contentitems having the associated respective user interaction events with thecommon user identifications and that are positive and having theassociated respective timestamps within the respective sliding timewindows.